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ABSTRACT, ' 

The intent ojf ' this study was to determine if any 
relationship existed between teacher effectiveness, based on selected 
criteria' generally <^ccepted by educators to denote effectiveness, and 
National Teacher /Examination, Teaching Area Examinations (TAE) and 
. Weighter Common Examination Total (WCET) scores, Teac.her 
effectiveness was determined by the building principal's evaluation. 
Analysis of the data was accomplished by determining relationship - 
through the correlation technique. It was found Hhat a significant, 
relationiship (c05 level) doe^ exist between the leacher '^Area . 
Examination* of the NTE and secondary principal-'s evaluation However , 
tio significant relationshif^ i?as , found between elementary principal's 
evaluation and any of . the NTE scores. (Author) 
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In this day and age it_ is particularly important for 
achievement and proficiency in any field to be rec.ognized. and 
capitalized up.on^. This is 410 less true, perhaps more true, ^ 
in teaching, whpre the tremendous pressures of accountability 
are being applied. Efforts to find new ways of identifying 
competences are, certainly in o^dev / External • examinat ions as 
predictors of competence , if used , properly , are among imaginative 
approaches that have b^en adopted ihcreasingly over the past 
decade . . 

- The National Teacher Examinations have ^been used to assess 
the knowledge of teachers and prospective teachers since 1940 
when^ the examinations were "first administered by the American 
Council on Education. In addition ™to using the examinations 
to measure teacher knowledge they, in many instances , have been 
used |by school systems in an attem^pt to measure present teacher 

effectiveness, e.g. , the 1971 report by the Alabama Education ^ 

• * ' ■ ' . . ' ' ' ' . . . <. 

„Study Commission that ^'indisputable evidence" (basepl on NTE. 

result^) provides information that , , many of Alabama's 

teacher college graduates are alarmingly deficient for a profession* 

in^ which proficiency is absolutely vital (1971)." The utility 

and accuracy of ratings of teacher performance have long been 

attacked and questioned, and this is especially true of 

\ 

principal ratings. The National Teacher Exarninat ions are ^ 

' • ^ ■ . r ^ 

essent ially achievement tests. How good are they as predictors 

of future performance?, Cromer, ( 1961 , pp 155-158 ) in his 

article on testing programs, states: 

• • ' '"^ ' • ^ 

Too often we fail to realize that a test score 
is best interpreted as a good estimate of the general 
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level of Iperjformance , -and that »it w^ll vary, from . * 
test to test and from time to. time. The assessment 
of human traits and abilities is not at the same-^^level 
of accuracy as that, found in a physits laboratory,. ^ 
It probably is closer to the^Xevel of accuracy 'found in 
^ the predictions of weather, in which tempe^atxire pre- 
c^ictions are generally within a few degrees, of actual 
temperatures, but in which differences qf ten or more 
degrees are .common enough to be remembered Vividly 
by critics , , . ' . ' ^ . . v 

'J • ^ 

This author goes on to say; ' ' 

There is considerable overlap between standardized 
tests of achievement and standardized^ intelligence 
tests. One of ^he Important differ^ces between', . 
the two is the way the result? are used. When 
» analyzing achievement test scores one Is generally 

looking for3vard to the future, pr^edicting performance, 

\ -r 

It is wfell to keep^ tn mind the fact that intelligence 
Is inferred from* achievement . We have no direct, measures 
of ihtelligehce completely divorced from achie^vement . - 

With the above distinctions in mind what a'bout the . 
National Teacher Examinations? These 'are achievement tests, 
but they are also used ^s 'the basis for predicting future 
achleveftient .or performance. This circumstance accounts forx 
some of' the confusion and ambivalence one encounters concerning 
these examinations r Is; the. situation contradictory? Probably 
not. Teachers must have' considerable education and preparation 
in Order to perform successfully as teachers. v Achievement is " 
expected in k variety of ways at adequate levels of competence''. 
Such achievement is not . poi^sible lacking sufficient basic 
intelligence but alone, without preparation and study and* ^ 
achieye"ment , does not qualify one for the *job to be donei 
Not Just any intelligent person is' by virture of his in- 
telligence qualified to be a physician, lawyer, architect,* 



teaciier or^.-wh^'t haTve you., without study 'and achievement related. 

■ ' . .-4 - * ■ • • - , ■ 

to the expecta^tions of. the particular profession. It follows 

•that test^ of ''eLChievement in areas * related to the; future woi^l? 

«o'f .a teacher provide useful^ information- concerning the general 
level of performance that may. be expected- in those areas in . " 
the future. If th'is is not so,, then we a3.1 live in' a fool^'s 
paradise. ' ^ ^/ v > , \ 

. One of the strongest ' s^upporters on. t|ie NTE (Seashore, 

'1965) 'indicates .the tests measure knowledge o^f^ub j'ect^ , 
professional understanding, \and mentaLVabilities which , experts/\, , 

*agree/^re a requisite jEor goo.d teaching* 

others (Bpozer, -1968 . and''-Lins , 194'6) agree and feel that . 
any tests of achievement in areas related to the future .work of^' 
a teacher provide . useful information concerning tiie-^^^neral 
lev^l of performance that may be expected i,n those areas in . ^ 
the future.' Ba:sed on- this.,, it is believed that .external 
teachers examinations, intelligently Interpreted* enable the 
colleges* to view their graduates, ^.nd the .school thei^r teachers,' 
in relation to persons of. comparable .educational exposure through 
out the country. * ^ ' ' ; , . ' 

The intent of this study was to determine if there is any 
cprrelatioh between l^eachef. effect iveness (based on criteria 
genei^ally used »to denote effectiveness) and NTE scores. 'The 
effectiveness was determined by the building principal'^ 
evaluation. This researcher is aware of the extreme limitations, 
and criticisms, of .using principal ratings to measure teacher* 



effectiveness: Nevertheless, "^a recent state 'wi'de .survey 
con'ducted i^n Alabama found (Brown gc'Maxson, 1972) that princi- 
pal tearing were us'ed more than all other types of . evaluation 
combine(i> to ' asses's teacher effectiveness. * ■ \ - ^ 

If principal ratings are so' widely^ used to measure- 
the ef f e.ct iv,e.ness oX teachers it appears it would be beneficial '^^ 
to determine if there exists any relationship between their 
rating on selected t,ea^cher characteristics (which have been 
cqmmonly listed^as qualities of effective^ teachers) and NTE ^ * 
scores . ^ / , . . . 

Quirk .et al"., (1973) stated in their review of the literature 
conc^erning^ the validity of the NTE that" they, had beejn unable 
to locate'.'a single 'Study "that used scores- earned on ^ny of 
the Teaching Area* Examinations (TAE) after 1964( »when these. 



scores were first^. equated to each other., The hypotheses t'ested 
in- this iny^estigation were: (1). to determine if there jLs a 



(relationship between TAE scores and !teach^T.• effectiveness of . 
-secondary teachers as determined by the secondary building 
principal ' s • evaluation ; (2) to determine if there is a relation- 

r ■ ■ . 

ship between TAE scor.es and teacher, effectiveness of elementary 

V 

teacher's as determined by the elementary building principal ' s 
evaluation; (a) to determine if.' there- is a,ny relationship 
between Weighter Common Examination Total (WCET) scores and 
selecteci characteristics of secondary teachers as determined ■ " 
by th^ secondary building principal ' s evaluation; and (4) to 
determine if- ther,e is any- relationship between WCET scores. 
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and selected characteristics of elementary teachers as de|er~ 
mined by the elementary building principal:^ s evaluaf'iQn . 

****■' i ' 

\ . A review of the literature was ' conduct ed to determine-an 
additional need for th^. study. Validation data" are-scarce ' 
■•'for reasons that seem to be well understood by those' who have ',■ 
..tried to evaluate success in >tea.ching . Crombach (1970) dis-- 
cussed a c'bmmori type of c'ritefion - the rating. He concluded 
that' ratings are not enti^rely satisfactory as criteria. The 
V rater may not know the facts- about the person. Often a rating; 
* reflects the personal relation between man and supervisor rather - 

' than the quality of' the man*s work. 

.■■'/'« • ■ ' . ' * ■ ' * ' . . ^ 

On the job ratings were studied by the Alabama Education 

Study Commission in the field of teaching. A memorandiim was- 

-released on^'june 17, 1971 by the" commission in which, they stated ■ 

-that'i they were publishing extensive data, reflect ing the resi^lts / 

of Na^tional Teacher Examination^ taken by 11^500 graduating 

Students of tv/enty-two teacher colleges in Alabama in 1968, 

1969, and 1970. \ * ,1 

This report was fiief with extensive criticism which 'was 

reflected in "^ome twenty 'newspaper articles throughout Alabuma 

dating. fronj June 18, through August 21, 1971. The commission 

reported that results of the NTE from 1968 through. 1970 showed/ 

.an average rating of Alabama students of thrity on a^ scale ^wtth . 

a top rating of one hundred and that the average rating ""qf the 

twenty-two Alabama teacher' colleges ranged from an average ' 

high ^of sixty-eight at the University of Alabama at Huntsville* 

' to a low of an average three at Alabama State University. 
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' The President of. Birmingham ^Southern', on^ of 'the- schools * 

:>scoring 'highest on the NTE, said that the scores indicate 

• that teachers trained at iSouthern have a wide and ^\i:ell-rounded 
^ background. ' jyr.-^ William Plunter, chairman of the School of 

Education at Tiiskegee . Institute^ a^id immediate. t>ast President 
.of AACTE,,said he has felt for som.e tinje that the NTE is' slanted 
. toward a particular educaf i,6nal philosophy^ and that it lacks 
balance on points of view. / • ' 

A ' determination was m^de by the investigator that a need 
exls^ted to prcvlL- statistical. 'data r'egardlng the rslatlcn^hips 
between the TAE and ,the WCET, and teacher, effectiveness as * * ..^ 
J measured by -principal evaluation's. \The four basic hypotheses, 
previously stated,- were developed to^^ test princij)a^l ratings 
arid their relationships to the TAE- and "the WCET. ^ ' ^ 

A rating* form was constructed by the investigator and • 
. m.ailed to each selected teacher's principal (n = 66). A 90% 
return was experienced giving a final sample size of 59 
(elementary = 22; secondary = 37). Each teacherVs name had 
.been obtained from the^ list of education graduates that hac^ 
taken the NTE at one , predominately whit e and one pffedominately ^ 
black university in Alabama. Each subject used in ' tliis . study 
had a mirf>imum of . threfe' years teaching experience. ^: 

A^nalysis of the' data was accomplished by determining 

• * . I* . ^ ^ 

"/relationship: th^otigh the. correlation technique. ,The sig'ni-f icance 
'level used lor the acceptance-rejection decision regarding 
^. th^^atateS , hypotheses was set/ at .05. The Weighted Common 
Examinations total score 'from the KTE were used withouo any 



transformations.' "The WCE. has been described as a test '*td 

measure general knowledge and ability;' requisi^te to e^ffecti^e 

teaching (Brownell , ;Jl95t) . ^Teaching Area Examination scores 

were also"" used without any transformations. The TAE ^'measures 

yo\ir ^understanding of subject' matter, and j^ethods applicable to 

(various)' subject areas' (NTE Bulletin , 1^72-73^ p.3).'»/' 

■ "* ' ' ' * ' _ 

'Teachers were %oted by their- principals on a "f ive pqint scale . 

' , ... . • ^ ^ ' • 

for ,15, personal -charact^iristics for effective teachi-hg (motivation 

classroom control , -creativity , knowledge of subject matter, 

innovativeness , adapt iveness , professionalism, empathy, cobpera-,. 

tiyenessv .mpraler imaginativeness,' tolerance, self- improvement , 

'dependability, and overall effect iveness ) . The data regarding 

'the principalis ratings and. WCET score? 'and 'the pr^inq^pal^s ^ 
ratings xand TAE scores were summed -injdi^/idually so as to pro-- 
duce an overall perfprmanoe rating. " . . 

The means, standard .deviations and correlations- were / 
computed for the four ^variables . .The resull^s are presented . 

^ in Tables' 1-5. . . " 



. • Table 1 , 

Principal Ratings of Teacher Ef f ec'tf veness 



Rater 



M 



SD 



Elementary Sphool Principal (n= ) 
Secondary School Principal (n= )., 



4,4 
3.8- 



,1.98 
1 . 8.7 



( 
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■ \ " Table 2 • 

/ 

■ WCET Scores (NTE): ' 






i 










' Subjects r 




M "< 


SD . 




Elementary Teacher^ 




623.3 


18;73 ' .. 




Secondary Teachers / 

.1 


< • 


^43.4 

- / 


19.02 





Table 3, 



TAE Sc o res (NTE) 



Subjects 



M 



•SD 



Elementary Teachers 
Secondary Teachers 



556.5 - 
607.. 6 



18.17 
21.81 



\ 



Table 4 

. / 

;orre.latlons -.Principal Ratings and WCET Scores 



* ■ / 

Rater/Subject ^ - 


' \ 

\ 

' df \ 




Elementary Principals/Teachers 
Secondary Principals/Teache.rs ^ 

" ^ ^ " ^ ; - 


^ 20 
35 ^ 


'/ .38 ^ 

■ .41* , i . 



(*P^.05) 
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Table .5 ' 



Correlations - principal ..Ratings and TAE Scores 



Rater/Subject 



.Elementary Principals/ teachers 
Secondary Principals/Teachers ' 



df 



20 
35 



,40 

,52**' 



' .(**P < .01) 
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The results, indicate that the secondary principal may 
put more emphasis on knowledge of subject, matter than does 
the elementary principal^. For example, a .secondary principal 
might say "he is a good algebra teacher*', *^where the elementary, 
principal would say, "he is a good teacher", thus perhaps 
explaining tjie significant relationship found between principals 
"ratings and TAE scores of^ secondary teachers and the lack of 
a significant relationship in the other areas^. 

It appears that a significant relationship does exist 
between TAE. scores and secondary principalis evaluation, and 
betVeen WCET scores and second,ary principalis evaluation. 
However, no such significant* relationship was found to exist 
concerning hypotheses two and four. A word- of caution is in 
order « The NTE is* a test of knowledge of the principles of 
tea{ ling, not, a test of the act of teaching. As yet there is 
no valid and r«^liable criterion for good teaching. 

k. 

The last point I wish to make concerns subsequent research 
in this area. It /occurred to this writer during the in.vesti- 
gation that, the crucial cognitive factor in teachings effective- 
ness is not intellectual aptitude or achievements as such but 
the teacher ^s general and special abilities -as' related to 
1) the subject matter of the. lesson, and 2) the level of each • 
child in^-.the class. For example, it may be found that a teacher 
who has average knowledge about 'the science of flowering plants 
has high ef f ecti vsness with the bright children in an elementary 
school science class, „poor effectiveness with the whole of a 



12 

junior high-school class in a cultura-lly-deprived neighborhood, 
and, once again,, high effectiveness with the slower children 
in a high-school class. If such/a complex interaction exists 
between the subject matter and the abilities of the child and 
teacher, and it does seem plausible, then the teacher's 
effectiveness must be weighed relative 'to a group of children 
with a given ability in each subject' matter area. 
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